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“It's hard enough to find an error in your 
code when youre looking for it; it's even 
harder when youve assumed your code is 


error-free.” 
— Steve McConnell © 2020 Philip Koopman J 
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Integration Testing University 


= Anti-Patterns: 
e Skipping straight to system test 
e No traceability from integration test 
to High Level Design 
e Integration test “pass” criterion based on 
system function, not interfaces 











COMPONENT 1 


COMPONENT 2 


COMPONENT 4 


=m Testing component integration: 
e Exercise all component interfaces 
— Correct responses to input sequences? 
— Handle all types of data on interfaces? 
e Ensure modules match HLD, including SDs 
— Assume unit test has vetted each component 
—- Concentrate on component interactions 






COMPONENT 3 
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Integration Test Approach To SDs Mellon 
= Exercise all interfaces sia 14 1 
e All inputs result in correct outputs — =e — 2 


e Every component interface exercised 
— With all relevant values 
— With all relevant timing & sequencing 
e Use SDs and HLD info drive testing 
— Pass/fail: does it match SD? 





Integration Test IT-1a: 
Initialize modules 


Test setup: CoinCount to zero 
Insert coin (1a) 

Observe CoinIn(true) (1b) 
Observe Coinin(false (1c) 
Observe mCoinCount == 1 (1d) 


= Integration test coverage: 
e All arcs on all SDs exercised? 
e Off-nominal behaviors tested? 


— Invalid sequencing and extraneous inputs? 
— Extraneous outputs? © 2020 Philip Koopman 4 


wo Cul > al ees 


Carnegie 














Tracing Integration Tests to SDs ue 
= Observe module interactions ral 
e Set up test 
— Meet SD preconditions SS ee 
e Feed input arc(s) to modules Test Input Cap 
e Observe intermediate arcs —_— a ar 
SS 
e Observe output arcs — ——p 
e Find a way to observe documented ay —— 
| 7 MF age meee ey 
side effects (e.g., final CoinCount) dustin Ray/Sustinz2 a a Oe 
Test Outputs 


= Integration test “pass” is 
not just based on final output 
e Do all the arcs appear in expected sequence? 
e Is timing appropriate? 
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Integration Tests and Messaging 


Mode @1 [edit] 


m Interfaces often look like “messages” 
e Categorical values (enums) 
e Data structures 
e Network packets 
m Integration testing should exercise 
“message structure 
e All types of messages 
e Valid and invalid field values 
e Timing, exception handling 
— e.g., bad checksum, bad sequence number 
= HLD will have the message dictionary 
e Defines message types, formats, etc. 
e Accompanied by a validation test suite 
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PIDs supported 
[01 - 20] 


Monitor status 
since DTCs 
cleared. (Includes 
malfunction 
indicator lamp 
(MIL) status and 
number of DTCs.) 
Freeze DTC 
Fuel system 
status 
Calculated engine 0 
load 
Engine coolant 
-40 
temperature 
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Formulal?! 
Bit encoded [A7..D0] == 


[PID $01..PID $20] See 
below 


Bit encoded. See below 


Bit encoded. See below 


100 A 
54 (or 2.55 ) 


A— 40 


OBDii Parameter ID message dictionary 
(CAN Network Messages) 


[https://en.wikipedia.org/wiki/OBD-II_PIDs] 
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= Trace Integration tests to HLD 

e Exercise all arcs on every SD 
e Cover all modules; all interfaces 


e Cover all message types and fields 








= Integration test pitfalls 
e System testing alone misses system integration edge cases 


— Sometimes a misbehaving system appears to work at system test 
— Can be difficult to exercise off-nominal SDs at system level 


If you skip HLD, you can‘ trace Integration Tests back to design 
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Solutions that might fix the problem without breaking anything 
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